Dynamic Coattention Networks for Reading Comprehension

نویسنده

  • Hayk Tepanyan
چکیده

We investigate the reading comprehension task using SQaAD dataset. The reading comprehension task is formulated as finding the answer span in the given paragraph for the given question. We describe multiple approaches to solving this problem starting from very simple baseline that gradually evolves into a much more complicated architecture. For each model we describe the underlying architecture and analyze its performance on the training and validation data. Our final model is a modification of the dynamic Coattention network described in the work of Socher et al. [1] and it achieves F1 = 58.6% and EM = 44.6% scores on the test set.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Deep Coattention Networks for Reading Comprehension

Machine reading comprehension of text is an important task in Natural Language Processing. A recently released dataset, the Stanford Question Answering Dataset (SQuAD) formulates the problem as question answering, and it provides a large corpus of challenging, realistic questions. To address this task, we implement an end-to-end neural encoder/decoder model. The encoder consists of the coattent...

متن کامل

SQuAD Reading Comprehension with Coattention

Reading comprehension is an important task in NLP, which involves teaching a machine to understand text enough to answer questions. The Stanford Question Answering Dataset (SQuAD) is a dataset consisting of 100,000 question-context-answer datapoints. Here, deep learning methods are used to answer questions based on context data. A model based on the Attentive Reader [1,2] model is used as a bas...

متن کامل

SQuAD reading comprehension deep learning model

We introduce a neural network model for reading comprehension using the SQuAD dataset. Our model is composed of a Dynamic Coattention Network encoder (Xiong et al. [2016]) and a novel decoder designed for runtime minimization. Our model obtained an F1 score of 52.283 when tested on the SQuAD dev set, and an exact-match score of 38.723.

متن کامل

Reading Comprehension Using Modified Match-LSTM

In this paper we detail our attemtps to replicate an extended Match-LSTM models that uses a dynamic loss function and a boundary based model with extensions based on observed parts of ynamic Coattention Models and a decoder that mirrors an AttentiveReader model.

متن کامل

Codalab username: wenqiwooo Simple Dynamic Coattention Networks

Reading comprehension (RC), or the capability to process document texts and answer questions about them is a difficult task for machines, as human language understanding and real-world knowledge are needed [4]. This can serve a wide range of applications, from simplifying information retrieval processes to building more robust artificial intelligence. Previously, most natural language processin...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2017